Faster Deep Q-learning using Neural Episodic Control

The research on deep reinforcement learning which estimates Q-value by deep learning has been attracted the interest of researchers recently. In deep reinforcement learning, it is important to efficiently learn the experiences that an agent has collected by exploring environment. We propose NEC2DQN that improves learning speed of a poor sample efficiency algorithm such as DQN by using good one such as NEC at the beginning of learning. We show it is able to learn faster than Double DQN or N-step DQN in the experiments of Pong.Comment: 6 pages, 6 figures, COMPSAC2018 short pape

Special section on concurrent/real-time and hybrid systems: Theory and applications

金沢大学理工研究域電子情報学

Deductive Schedulability Verification Methodology of Real-Time Software using both Refinement Verification and Hybrid Automata

Real-time software runs over real-time operating systems, and guaranteeing Qualities is difficult. As timing constraints and resource allocations are strict, it is necessary to verify schedulability, safety and liveness properties. In this paper, we formally specify real-time software using hybrid automata and verify its schedulability using both deductive refinement theory and scheduling theory. In this case, the above real-time software consists of periodic processes and a fixed-priority preemptive scheduling policy on one CPU. Using our proposed methods, we can uniformally and easily specify real-time software and verify its schedulability based on hybrid automata. Moreover, we can verify its schedulability at design stage

Genome-wide search for strabismus susceptibility loci.

The purpose of this study was to search for chromosomal susceptibility loci for comitant strabismus. Genomic DNA was isolated from 10mL blood taken from each member of 30 nuclear families in which 2 or more siblings are affected by either esotropia or exotropia. A genome-wide search was performed with amplification by polymerase chain reaction of 400 markers in microsatellite regions with approximately 10 cM resolution. For each locus, non-parametric affected sib-pair analysis and non-parametric linkage analysis for multiple pedigrees (Genehunter software, http://linkage.rockefeller.edu/soft/) were used to calculate multipoint lod scores and non-parametric linkage (NPL) scores, respectively. In sib-pair analysis, lod scores showed basically flat lines with several peaks of 0.25 on all chromosomes. In non-parametric linkage analysis for multiple pedigrees, NPL scores showed one peak as high as 1.34 on chromosomes 1, 2, 4, 7, 10, 15, and 16, while 2 such peaks were found on chromosomes 3, 9, 11, 12, 18, and 20. Non-parametric linkage analysis for multiple pedigrees of 30 families with comitant strabismus suggested a number of chromosomal susceptibility loci. Our ongoing study involving a larger number of families will refine the accuracy of statistical analysis to pinpoint susceptibility loci for comitant strabismus.&#60;/P&#62;</p

Clinical correlations of aggrecan in the resected medial rectus muscle of patients with intermittent exotropia.

The purpose of this study was to elucidate the role of extracellular matrix components such as aggrecan, fibronectin, and laminin in the extraocular muscle of patients with strabismus. Resected tissues of the medial rectus muscle of 47 patients with intermittent exotropia obtained during recession-resection surgery were frozen under liquid nitrogen and pulverized by a Freezer/Mill to solubilize the tissue for enzyme immunoassay. The total amounts of aggrecan, fibronectin, and laminin in the resected tissue were correlated with clinical data of patients such as age, exodeviation, and refractive error. The amount of aggrecan decreased significantly with the advance of age (P &#60; 0.0001, Spearman rank correlation test), while the amount of laminin or fibronectin had no correlation with age. Patients with basic type intermittent exotropia showed larger, although not significantly, amounts of aggrecan than those with convergence insufficiency type (P = 0.0538, Mann-Whitney U-test). The amount of aggrecan may be related to motor aspects of intermittent exotropia.</p